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[Document Name] Specification 

[Title of the Invention] REACTION INFORMATION DISPLAY SYSTEM 

5 [Technical Field] 

This invention relates to a reaction information display 
system or the like, in particular to a technique for displaying 
reaction information in a system having a provider side terminal 
device and a user side terminal device that can make 
10 communication through an information communication network. 

[Background Art] 

A learning system is known that transmits a teacher's image 
and voice in real time through a network to a large number of 

15 students. With such a learning system, though simple, students, 
while staying at home, can receive the same lecture as that given 
in the classroom. With such a conventional learning system, 
however, because individual student's reaction does not reach 
the teacher giving lecture, students' reaction cannot be fed 

20 back to the lecture like with the teaching in the classroom. 

On the other hand, as a network type of learning system that 
can grasp the students' reaction is proposed in which a network 
type of multi-user virtual space is used (JP-A-H 8-212173) . 
This system defines a virtual space in which a plural number 

25 of learning steps and respective students are displayed as 
objects, so that one can observe at the teacher terminal the 
students' situation as they move along in the virtual space with 
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the progress of the learning step. 

Another network type of system is also proposed in which a 
TV camera is placed at the students' terminals, so that 
students' facial expressions can be observed at the teacher 
5 terminal. 

However, the former system requires a complicated system 
configuration and, on top of that, the system is not the one 
that realizes the form of lecture normally given in classrooms 
in which reactions of many students receiving the same lecture 

10 contents are fed back in real time. Moreover, the latter system 
requires special equipment such as TV cameras and broad band 
lines at the terminals of all the students and, on top of that, 
because of enormous amount of information, transmission of 
information becomes slow. Further, due to the limit to the 

15 network load, the number of students that can be displayed 
simultaneously at the teacher terminal is limited. Thus, with 
the increase in the number of students, it becomes impossible 
to grasp reactions of all the students in real time like in the 
classroom. 

20 

[Disclosure of the Invention] 

An object of this invention is to provide a reaction 
information display system that, although simple in 
constitution without using special equipment, can solve the 
25 above problems with the conventional learning system using the 
network as described above and grasp in real time many users' 
reaction to a single piece of evaluated object information 
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presented through an information communication network. 

A reaction information display system according to this 
invention includes: 

a provider side terminal device having a provider side display 

5 device, and 

a plural number of user side terminal devices, each having 
a user side input operation device and a user side display device, 
and capable of communicating through an information 
communication network with the provider side terminal device, 

10 characterized in that 

the provider side terminal device has a evaluated object 
information transmission means for transmitting evaluated 
object information, 

the user side terminal device has a evaluated object 

15 information display means for receiving and displaying the 
evaluated object information transmitted from the provider side 
terminal device through the information communication network 
on the user side display device, and a reaction information 
transmission means for transmitting reaction information made 

20 to correspond to the user side terminal device when the user 
side input operation device is operated in reaction to the 
evaluated object information displayed, and 

the provider side terminal device further has a reaction 
information display means for receiving reaction information 

25 transmitted from the user side terminal device through the 
information communication network and for displaying 
information corresponding to the received reaction information 
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on the provider side display device. 

The provider side terminal device according to this invention 
is the provider side terminal device used in a system including: 

the provider side terminal device having a provider side 
5 display device, and 

a plural number of user side terminal devices each having a 
user side input operation device and a user side display device, 
and capable of communicating through an information 
communication network with the provider side terminal, 
10 characterized by including: 

a evaluated object information transmission means for 
transmitting evaluated object information, and 

a reaction information display means for receiving through 
the information communication network the reaction information, 
15 made to correspond to the user side terminal device, transmitted 
as a result of the user side input operation device being 
operated in reaction to the evaluated object information 
transmitted with the evaluated object information transmission 
means and received through the information communication 
20 network with the user side terminal device and displayed on the 
user side display device, and for displaying information 
corresponding to the received reaction information on the 
provider side display device. 

The user side terminal device according to this invention is 
25 the user side terminal device used in a system including: 

the provider side terminal device having the provider side 
display device, and 
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a plural number of user side terminal devices, each having 
the user side input operation device and the user side display 
device, and capable of communicating through the information 
communication network with the provider side terminal, 
5 characterized by including: 

a evaluated object information display means for receiving 
through the information communication network the evaluated 
object information transmitted from the provider side terminal 
device and for displaying the received information on the user 
10 side display device, and 

a reaction information transmission means for transmitting 
reaction information when the user side input operation device 
is operated in reaction to the displayed evaluated object 
information, so that information, made to correspond to the user 
15 side terminal device and corresponding to the reaction 
information, transmitted through the information 
communication network to the provider side terminal device, is 
displayed on the provider side display device. 

A computer program according to this invention is 
20 characterized by causing a provider side terminal device used 
in a system including: 

a provider side terminal device having a provider side display 
device, and 

a plural number of user side terminal devices each having a 
25 user side input operation device and a user side display device, 
and capable of communicating through an information 
communication network with the provider side terminal, 
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to function as: 

a evaluated object information transmission means for 
transmitting evaluated object information, and 

a reaction information display means for receiving reaction 
5 information made to correspond to the user side terminal device 
transmitted through the information communication network when 
the user side input operation device is operated in reaction 
to the evaluated object information transmitted from the 
evaluated object information transmission means and received 
10 with the user side terminal device through the information 
communication network and displayed on the user side display 
device, and for displaying information corresponding to the 
received reaction information on the provider side display 
device . 

15 A computer program according to this invention is 

characterized by causing a user side terminal device used in 
a system including: 

a provider side terminal device having a provider side display 
device, and 

20 a plural number of user side terminal devices each having a 
user side input operation device and a user side display device, 
and capable of communicating through an information 
communication network with the provider side terminal, 
to function as: 

25 a evaluated object information display means for receiving 
evaluated object information transmitted from the provider side 
terminal device through the information communication network 
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and displaying the received information on the user side display 
device, and 

a reaction information transmission means for transmitting 
reaction information when the user side input operation device 
5 is operated in reaction to the displayed evaluated object 
information, so that information, made to correspond to the user 
side terminal device and corresponding to the reaction 
information and transmitted through the information 
communication network to the provider side terminal device, is 
10 displayed on the provider side display device. 

While the features of the invention are broadly described 
above, its configuration and details together with its objects 
and features will become more apparent along with the following 
disclosure in reference to appended drawings. 

15 

[Brief Description of Drawings] 

Fig. 1 shows a constitution of a reaction information display 
system 2 as an embodiment of the invention. 

Fig. 2 is a block diagram of constitution of a provider side 
20 terminal device 4 and a communication information memory device 
10 that constitute the reaction information display system 2 
shown in Fig. 1. 

Fig. 3 is a block diagram of constitution of a user side 
terminal device 6 that constitutes the reaction information 
25 display system 2 shown in Fig. 1. 

Fig. 4 is a block diagram for explaining the hardware 
constitution of a teacher terminal 4 as the provider side 
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terminal device 4 . 

Fig. 5 is a block diagram for explaining the hardware 
constitution of a student terminal 6 as the user side terminal 
device 6. 

5 Fig. 6 is a block diagram for explaining the hardware 

constitution of a data control server 10 as the communication 
information memory device 10. 

Fig. 7 is an example flowchart of the flow of reaction 
information display process. 
10 Fig. 8 is a flowchart in detail of part of the process shown 
in Fig. 7. 

Fig. 9 is a flowchart in detail of part of the process shown 
in Fig. 8. 

Fig. 10 is a flowchart in detail of another part of the process 
15 shown in Fig. 8. 

Fig. 11 is a flowchart in detail of still another part of the 
process shown in Fig. 8. 

Fig. 12 is an example flowchart of the flow of communication 
information reproduction process. 
20 Fig. 13 shows an example of data constitution of a 
communication information database 80. 

Fig. 14A shows an example of data constitution of evaluated 
object information demand signal used in communication 
information reproduction process. 
25 Fig. 14B shows an example of data constitution of reaction 
information demand signal used in communication information 
reproduction process. 
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Fig, 15 is for explaining the appearance of a display screen 
100 of an LCD 44 of a teacher terminal 4 in the reaction 
information display process. 

Fig. 16 is another view for explaining the appearance of the 
5 display screen 100 of the LCD 44 of the teacher terminal 4 in 
the reaction information display process. 

Fig. 17 is for explaining the appearance of a display screen 
110 of an LCD 64 of a student terminal 6 in the reaction 
information display process. 
10 Fig. 18 is still another view for explaining the appearance 
of the display screen 100 of the LCD 44 of the teacher terminal 
4 in the reaction information display process. 

Fig. 19 is for explaining the appearance of the display screen 
100 of the LCD 44 of the teacher terminal 4 in the communication 
15 information reproduction process. 

[Best Mode for Carrying out the Invention] 

Fig. 1 shows a constitution of a reaction information display 
system 2 as an embodiment of the invention. In the reaction 
20 information display system 2, the provider side terminal device 
4 and a plural number of user side terminal devices 6 are made 
mutually communicable through an information communication 
network 8 . 

Figs. 2 and 3 are block diagrams of the constitution, 
25 respectively, of the provider side terminal device 4 and the 
communication information memory device 10, and of the user side 
terminal device 6, that constitute the reaction information 
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display system 2 shown in Fig. 1. 

As shown in Fig. 2, the provider side terminal device 4 has 
a provider side input device 11, a provider side display device 
12, a reaction information display means 13, a communication 
5 information reproduction means 14, a evaluated object 
information display means 15, and a evaluated object 
information transmission means 16. 

The evaluated object information inputted through the 
provider side input device 11, while being displayed through 

10 the evaluated object information display means 15 on the 

provider side display device 12, is also transmitted through 
the evaluated object information transmission means 16. 

The reaction information display means 13 receives the 
reaction information transmitted from the user side terminal 

15 device 6 through the information communication network 8 and 
at the same time displays information corresponding to the 
received reaction information on the provider side display 
device 12 . The reaction information display means 13 has a user 
icon display means 13a, a reaction character string display 

20 means 13b, a reaction graph display means 13c, and a reaction 
record display means 13d. 

The user icon display means 13a controls to define, on part 
of the provider side display device 12, a user icons collective 
display area in which a plural number of user icon display areas 

25 are put in order and to display, using icons, pieces of 

information corresponding to pieces of reaction information 
from respective user side terminal devices 6 in corresponding 
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user icon display areas. This embodiment is arranged that the 
colors of user icons are changed according to the items of the 
reaction information . 

The reaction character string display means 13b controls to 
5 display, on the provider side display device 12, character 
strings (for example, "I see." and "???") corresponding to the 
reaction information from the respective user side terminal 
devices 6. Therefore, it is easy to grasp what contents of 
reaction information are received. This embodiment is 

10 arranged to display the reaction character string and the icons 
simultaneously. Therefore, it is possible to grasp at a glance 
which user shows what contents of reaction. 

The reaction graph display means 13c controls to display, 
using a graph on the provider side display device 12, 

15 statistical values of the reaction information from respective 
user side terminal devices 6, for example the frequency of 
reception of respective pieces of information. Therefore, it 
is easy to grasp the tendency of reaction from many users . This 
embodiment is arranged to simultaneously display the reaction 

20 graph, icons, and reaction character string. Therefore, it is 
possible to grasp at a glance which user has made what reaction 
together with the tendency of reaction from many users. 
Therefore, it is possible for the information provider to have 
the same feeling as in a scene with all the users in the same 

25 place, facing the information provider, seeing and listening 
to the evaluated object information. 

The reaction record display means 13d controls to display a 
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list of reaction information from the user side terminal devices 
6 in time sequence on the provider side display device 12. This 
embodiment is arranged to display the details of the respective 
pieces of reaction information as related to the respective 
5 senders or users. Therefore, it is easy to grasp what response 
was (is) frequent in what time zone ( for example currently ) from 
which user. 

The communication information reproduction means 14 acquires, 
while specifying communication time and information type, the 

10 whole or part of the information communicated between the 

terminals 4 and 6 and stored in a communication information 
database 80 (to be described later) , and reproduces and displays 
information corresponding to the acquired information on the 
provider side display device 12. 

15 The communication information memory device 10 has a 

communication information database 80 for storing information 
contents, related to communication time and type of information, 
communicated between the terminal devices constituting the 
system 2, namely between the provider side terminal device 4 

20 and a plural number of user side terminals 6. 

Next, as shown in Fig. 3, the user side terminal device 6 has: 
a user side input operation device 31, a user side display device 
32, a reaction information display means 33, a communication 
information reproduction means 34, a evaluated object 

25 information display means 35, a reaction information 
transmission means 36, and an other user information 
acquisition means 37. 
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The evaluated object information display means 35 receives 
evaluated object information transmitted from the provider side 
terminal device 4 through the information communication network 
8 and displays it on the user side display device 32. 
5 The reaction information transmission means 36, when the user 
side input operation device 31 is operated in reaction to the 
evaluated object information displayed on the user side display 
device 32, transmits reaction information made to correspond 
to the user side display device 32. 

10 The other user information acquisition means 37 receives 
reaction information transmitted from other user side terminal 
device 6 through the information communication network 8. 

The reaction information display means 33, concerning the 
reaction information received from other user through the other 

15 user information acquisition means 37 and own reaction 

information created by the operation on the own user side input 
operation device 31, displays the information corresponding to 
the reaction information on the own user side display device 
32. The reaction information display means 33 has: a user icon 

20 display means 33a, a reaction character string display means 
33b, a reaction graph display means 33c, and a reaction record 
display means 33d. 

The user icon display means 33a, the reaction character string 
display means 33b, the reaction graph display means 33c, and 

25 the reaction record display means 33d are the same in 

constitution as the user icon display means 13a, the reaction 
character string display means 13b, the reaction graph display 
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means 13c, and the reaction record display means 13d of the 
reaction information display means 13 of the provider side 
terminal device 4 shown in Fig. 2 except for displaying the 
information corresponding to the reaction information on the 
5 own user side display device 32. 

Therefore, it is possible for each user to share the same 
feeling as if all the users were present in the same place facing 
the information provider to watch and listen to the evaluated 
ob j ect information . 

10 The communication information reproduction means 34 acquires, 
while specifying communication time and type of information, 
the whole or part of the information communicated between the 
terminals 4 and 6 and stored in the communication information 
database 80 of the communication information memory device 10, 

15 and reproduces and displays information corresponding to the 
acquired information on the user side display device 32. 

Figs. 4 to 19 are illustrations or explaining an example in 
which the reaction information system 2 is applied to remote 
teaching. 

20 Figs. 4, 5, and 6 are respectively block diagrams for 

explaining the hardware constitution of the teacher terminal 
4 as the provider side terminal device 4, the student terminal 
6 as the user side terminal device 6, and the. data control server 
10 as the communication information memory device 10. 

25 As shown in Fig. 4, the teacher terminal 4 has: a hard disk 
50 as a memory means or memory medium with a program of the 
teacher terminal 4 side recorded thereon; a CPU 42 as a control 
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means that loads the program recorded on the hard disk 50 onto 
a main memory 40 and executes it; the LCD (liquid crystal 
display) 44 as the provider side display devices 12; the 
provider side input devices 11 including: a keyboard 4 6, a mouse 
5 48, a pen tablet 54, a camera 56 and a microphone 58; and a 
communication interface 52 for communicating with the student 
terminals 6 and the data control server 10 through the Internet 
8 as the information communication network 8. 

As shown in Fig. 5, the student terminal 6 is a general purpose, 

10 personal computer having: the provider side display device 32 
including the LCD 64 and a speaker 74, the user side input 
operation device 31 including the keyboard 66 and a mouse 68, 
a recording medium or a hard disk 70 for recording a program 
such as an OS (operation system) , a CPU 62 that loads the program 

15 recorded on the hard disk 70 onto a main memory 60 and executes 
it, and a communication interface 72 for communicating with the 
teacher terminal 4, other student terminals 6 and the data 
control server 10 through the Internet 8. 

In case a student wants to attend a lecture in this embodiment, 

20 the student can access through the Internet 8 to a program 
distribution server (not shown) . Then, a program for the 
student terminal 6 side of this system is automatically loaded 
onto the main memory 60 of the student terminal 6 and executes 
it. Therefore, the main memory 60 may also be taken as a 

25 recording medium on which is recorded the program on the student 
terminal 6 side of the system. When attending the lecture is 
over, the program is automatically erased. 
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As shown in Fig. 6, the data control server 10 has a hard disk 
24 or a recording medium on which are recorded at least an OS 
and a program for database, a CPU 22 for running the program 
or the like recorded on the hard disk 24, and a communication 
5 interface 26 for communicating with the teacher terminal 4 and 
the student terminals 6. 

Next, Fig. 7 is an example flowchart of the flow of reaction 
information display process. Fig. 8 shows partial details of 
the process flowchart shown in Fig. 7. Figs. 9 to 11 show 

10 partial details of the process shown in Fig. 8. Fig. 12 is an 
example flowchart of the flow of communication information 
reproduction process . 

Fig. 13 shows an example of data constitution in the 
communication information database 80. Figs. 14A and 14B show 

15 examples of data constitution of the evaluated object 

information demand signal and reaction information demand 
signal, respectively, used in communication information 
reproduction process. 

Figs. 15, 16, and 18 are illustrations for explaining the 

20 appearance of the display screen 100 of the LCD 44 of the teacher 
terminal 4 in the reaction information display process. Fig. 
17 is a drawing for explaining the appearance of the display 
screen 110 of the LCD 64 of the student terminal 6 in the reaction 
information display process. Fig. 19 is a drawing for 

25 explaining the appearance of the display screen 100 of the LCD 
4 4 of the teacher terminal 4 in the communication information 
reproduction process. 
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The reaction information display process and the 
communication information reproduction process are described 
in reference to Figs. 4 to 19 for the case in which the reaction 
information display system 2 is applied to the remote teaching. 
5 First, the CPU 42 of the teacher terminal 4 shown in Fig. 4 
is monitoring, as shown in Fig. 7, whether or not evaluated 
object information is inputted, and in case the evaluated object 
information is not inputted, moves the control to the step S4 
(step SI) . 

10 The evaluated object information and its input method are 
described. The evaluated object information is the 
information as the subject of evaluation by the students, 
transmitted to the students or users. The students return the 
evaluation of the evaluated object information in the form of 

15 reaction information to the teacher, the provider of the 
evaluated object information. In this embodiment, the 
evaluated object information is assumed to include for example 
graphic information, image information, and voice information. 
The graphic information is the information displayed on the 

20 graphic display area 111 constituting the display screen 110 
of the LCD 64 of the student terminal 6 shown in Fig. 17. The 
graphic information includes for example on-blackboard 
information 106 and choice information 107. 

The on-blackboard information 106 is the information such as 

25 characters, drawings, symbols, etc. handwritten by the teacher . 
While the method of inputting the on-blackboard information 106 
is not limited particularly, the information is inputted for 
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example from the pen tablet 54 constituting the teacher terminal 
4 shown in Fig. 4. In that case, the teacher compares the pen 
tablet 54 for example to a whiteboard and writes on it. 
The choice information 107 is the information indicating 
5 choices given from the teacher to the students. Normally, a 
set of pieces of choice information 107, 107, . . . inputted from 
the teacher terminal 4 are displayed on the graphic display area 
111 constituting the display screen 110 of the LCD 64 of the 
student terminals 6. As described later, when any piece of the 
10 choice information 107 is clicked (chosen) at a student terminal 
6, a piece of information indicating the chosen information 107 
is transmitted as reaction information from the student 
terminal 6. 

While the method of inputting the choice information 107 at 
15 the teacher terminal 4 is not limited particularly, it is 
inputted for example using the choice input area 104 
constituting the display screen 100 of the LCD 44 of the teacher 
terminal 4 shown in Fig. 15. That is, the choice information 
107 is set in the choice setting area 104a of the choice input 
20 area 104 and then the information 107 is inputted by clicking 
(choosing) a corresponding choice display button 104c. 

Setting the choice information 107 in the choice setting areas 
104a may be made by inputting character data directly into the 
choice setting area 104a using the keyboard 46. Alternatively, 
25 the setting may also be made by registering in advance sets of 
pieces of information frequently used (such as "great," 
"equal," and "small") in a choice registering area (not shown) 
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of the hard disk 50, choosing a required set of choices from 
among the plural number of pieces of choice information 
displayed on a registered choice display area 104b, and setting 
them in the choice setting areas 104a, 104a, .... 
5 Next, the image information is the information displayed on 
the image display area 112 constituting the display screen 110 
of the LCD 64 of the student terminal 6 shown in Fig. 17. The 
image information includes for example animation (or movie) 
information and still picture information. 

10 While the method of inputting the image information is not 
limited to a particular one, it is inputted for example from 
the camera 56 constituting the teacher terminal 4 shown in Fig. 
4. The constitution of the camera 56 is not limited 
particularly but may be changed according to the type of the 

15 image information. In case the image information is animation 
information, for example a TV camera is used as the camera 56. 
In case the image information is still picture information, for 
example a digital camera is used. As a matter of course, 
prerecorded image information may be inputted through specific 

20 input means. 

The voice information is the information outputted from the 
speaker 74 Q f the student terminal 6 shown in Fig. 5. While 
the method of inputting the voice information is not limited 
particularly, the information is inputted for example through 

25 the microphone 58 constituting the teacher terminal 4 shown in 
Fig. 4. As a matter of course, it is also possible to input 
prerecorded voice information through specific input means. 
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While the contents of the image information and the voice 
information are not limited particularly, they include for 
example facial expression, voice, etc. of the teacher giving 
a lecture. 

5 Referring again to Fig. 7, when the evaluated object 

information is inputted at the teacher terminal 4 as described 
above, the CPU 42 of the teacher terminal 4 transmits the 
evaluated object information inputted through the interface 52 
while displaying the whole or part of the information on the 

10 teacher terminal 4 (steps S2 and S3) . 

As shown in Fig. 16, with this embodiment, out of the evaluated 
object information transmitted, the on-blackboard information 
106 and the choice information 107 constituting the graphic 
information is displayed on the graphic display area 101 . 

15 constituting the display screen 100 of the LCD 44 of the teacher 
terminal 4 . 

The steps S2 and S3 in Fig. 7 respectively correspond to the 
evaluated object information transmission means 16 and the 
evaluated object information display means 15 in Fig. 2. 

20 As shown in Fig. 7, the evaluated object information 

transmitted from the teacher terminal 4 is received through the 
Internet 8 with the student terminals 6. In other words, the 
CPU 62 of the student terminal 6 is monitoring whether or not 
the evaluated object information is received. In case the 

25 evaluated object information is not received, it moves the 
control to the step S13. In case the evaluated object 
information is received, it displays the information on the 
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student terminal 6 (steps Sll and S12) . 

Of the evaluated object information received with the student 
terminal 6, voice information is reproduced with the speaker 
74. Graphic information and image information are 
5 respectively displayed in the graphic display area 111 and the 
image display area 112 of the display screen 110 of the LCD 64 
shown in Fig. 17. 

The step S12 in Fig. 7 corresponds to the evaluated object 
information display means 35. 

10 As shown in Fig. 7, the CPU 62 of the student terminal 6 is 
monitoring (step S13) whether or not reaction information to 
the evaluated object information displayed is inputted. In 
case the reaction information is inputted, the control goes to 
the step S16 (step S13). 

15 While the mode and contents of the reaction information are 
not limited particularly, there are for example comprehension 
degree information indicating the degree of understanding by 
the student of the evaluated object information and choice 
answer information indicating the answer by the student to the 

20 displayed choice information. 

While the method of inputting the reaction information is not 
limited particularly, it is preferable to input the information 
through an operation device, usually provided on general 
personal computers, such as a keyboard or mouse. Moreover, in 

25 case a voice input system (not shown) can be used, a microphone 
can also become an input operation device. 

Examples of contents and input method of the comprehension 



21 



023WO01eng.doc 

degree information and the choice answer information are 
described in reference to the display screen 110 of the LCD 64 
of the student terminal 6 shown in Fig. 17. 

A comprehension degree information input area 113 is defined 
5 in the lower part of the graphic display area 111 of the display 
screen 110. In the comprehension degree information input area 
113, a plural number of choices, in the form of buttons, are 
displayed corresponding to the comprehension degrees. In this 
example is displayed a button 113a ("I see") corresponding to 

10 a choice indicating comprehension, and a button 113b ("???") 
indicating incomprehension. A student can input comprehension 
degree information by clicking (choosing) one of the buttons 
displayed in the comprehension degree information input area 
113 that matches his or her own comprehension degree. 

15 On the other hand, in case choice questions are displayed, 
or a plural pieces of choice information 107, 107, . . . are 
displayed on the display screen 111, a student may click 
(choose) a piece of choice information 107 to be his or her own 
answer. Information corresponding to the choice information 

20 107 chosen as described above is the choice answer information. 
When the reaction information is inputted at the student 
terminal 6 as described above, the CPU 62 of the student terminal 
6, as shown in Fig. 7, transmits the inputted reaction 
information through the communication interface 72 and also 

25 displays the whole or part of the information on his or her own 
student terminal 6 (steps S14 and S15) . 

The step S14 in Fig. 7 corresponds to the reaction information 
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transmission means 36 in Fig. 3. The step S15 will be described 
later . 

As shown in Fig. 7, the reaction information transmitted from 
the student terminal 6 is received with the teacher terminal 
5 4 through the Internet 8. In other words, the CPU 42 of the 
teacher terminal 4 is monitoring whether or not reaction 
information is inputted, and in case the reaction information 
is not received, returns the control to the step SI. On the 
other hand, in case the reaction information is received, 

10 information corresponding to that is displayed on the teacher 
terminal 4 (steps S4 and S5) . 

While displayed contents and displaying method of the 
information corresponding to the received reaction information 
are not limited particularly, for example a user icon, reaction 

15 character string, reaction graph and reaction record are 

displayed on the display screen 100 of the LCD 44 of a teacher 
terminal 4. The user icon, reaction character string, reaction 
graph, and reaction record are delineated below. 

In a user icon collective display area 102 defined in the lower 

20 part of the graphic display area 101 of the display screen 100 
of the teacher terminal 4 shown in Fig. 18, are provided a plural 
number of user icon display areas as lined up in proper formation 
corresponding one to one to the respective student terminals 
6. User icons 102a, 102b, 102c, ... are displayed respectively 

25 in the user icon display areas. It is adapted that the color 
of the user icon corresponding to the student terminal 6, or 
to the transmission origin of the reaction information, varies 
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according to the contents of the reaction information. 
Therefore, it is easy to grasp the comprehension degree of each 
student for the evaluated object information and the contents 
of answer of each student for the choice problem. 

In this example, the students corresponding to the user icons 
102a, 102b, and 102c respectively exhibit reactions 
corresponding to "???," "I see," and "I see," while other 
students exhibit no reactions at all. 

In the graphic display area 101 of the display screen 100, 
character strings corresponding to the pieces of reaction 
information (for example the comprehension degree information, 
"I see" and "???") from the student terminals 6 are displayed 
as reaction character strings 108, 108, .... As a matter of 
course, reaction information other than the comprehension 
degree information, for example character strings 
corresponding to the items of the choice answer information, 
may be displayed as reaction character strings. 

This example is also adapted that reaction character strings 
of predetermined colors corresponding to the contents of the 
reaction information are displayed randomly in undefined 
positions in the graphic display area 101 for only a 
predetermined period of time . This example is also adapted that 
the reaction character strings 108 and the user icons 102a, . . . 
are displayed simultaneously. Therefore, it is easy to see 
which student showed what contents of reaction even if an 
observer does not know the meanings of the colors of the user 
icons 102a, .... 
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Further, reaction graph columns 109 showing the number of 
times of receiving reaction information from the student 
terminal 6 are displayed in the graphic display area 101 of the 
display screen 100 . This example is adapted to display reaction 
5 graph columns 109a, 109b in different colors for the items of 
reaction information, and at the same time, a sum of these with 
a reaction graph column 109c. In this way, total number of 
reactions can be seen. Like the case of the reaction character 
string, reaction information other than the comprehension 

10 degree information, for example a graph column corresponding 
to an item of the choice answer information may be displayed 
as a reaction graph column. 

This example is also adapted that the height of the reaction 
graph column 190a, . . . corresponding to the number of times of 

15 receiving the reaction information is renewed every time the 
number increases, and the graph column 190a, ... is deleted (by 
gradually reducing the height) when there is no same reaction 
information item within a predetermined period of time. 
Therefore, it is possible to grasp current occurrence frequency 

20 of every piece of reaction information while taking into 

consideration of accumulated number of times within a certain 
period of time. 

On the left side of the graphic display area 101 of the display 
screen 100 shown in Fig. 15, a reaction record listing area 103 

25 is defined to list the reaction information from the student 
terminals 6 in time sequence. In this embodiment, the list is 
made so that the contents of reaction information correspond 
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to respective students, the transmitting persons. Therefore, 
it is easy to grasp what type of reaction comes frequently from 
which user in which time zone. 

Fig. 8 shows details of step S5 of the process in which the 
5 user icons, reaction character strings, reaction graph columns , 
and reaction records are listed. In other words, in the step 
S5, the CPU 42 of the teacher terminal 4 executes the process 
steps of user icon display, reaction character string display, 
reaction graph display, and reaction record display (steps S31, 
10 S32, S33, and S34) . 

First, the user icon display step (step S31) is described. 
As described above, the user icons 102a, 102b, 102c, . . . shown 
in Fig. 18 correspond to the student terminals 6, 6, 6, 
each provided with a user ID (identity symbol) . Further, a user 
15 ID as a transmission origin ID is attached to received reaction 
information, so that it is possible to discriminate where the 
reaction information has come from, upon seeing the reaction 
information (See Fig. 13) . 

Moreover, the user icons 102a, 102b, 102c, . . . are 
20 respectively time-wise controlled with individual countdown 
timers (not shown), each provided with a countdown timer ID 
(identity symbol) . 

Therefore, it results in that the user icons 102a, 102b, 
102c, ... respectively correspond to individual user ID's and 
25 countdown timer ID's. 

This user icon display step is adapted to execute the display 
process for each of the user icons 102a, 102b, 102c, .... The 
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user ID and the countdown timer ID that correspond to the user 
icon to be the subject of the display process are respectively 
called as the noted user ID and the noted countdown timer ID. 
Detailed contents of the user icon display step, the step S31, 
5 are described in reference to Fig. 9. First, the CPU 42 of the 
teacher terminal 4 executes an initializing step (step S41) . 
In the initializing step, specific initial values are set for 
the noted user ID and the noted countdown timer ID. 

Next, the CPU 42 determines whether or not the transmission 

10 origin ID of the received reaction information corresponds with 
the noted user ID. In case of correspondence, a color 
corresponding to the reaction information is given to a user 
icon corresponding to the noted user ID. At the same time, a 
countdown timer indicated with the noted countdown timer ID is 

15 reset, and the control goes to step S32 (steps S42 to S44). 

The countdown timer is a timer that counts down. When the 
value of the timer becomes "0," it stops counting. When reset, 
it resumes countdown from a specified time point. When the 
value of the countdown timer becomes "0" in the user icon display 

20 process, a specified indication (for example yellow flashing) 
is made at a corresponding user icon. In effect, this timer 
functions as a timer for discriminating student terminals (or 
no-reaction students) that give no reaction information during 
the preset period of time. 

25 While the above preset period of time is not limited 

particularly, it is set to an appropriate period of time for 
example 1 to 5 minutes. Also it is possible to permit the 
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teacher to set freely at the teacher terminal 4 according to 
the contents of the evaluated object information. 

In case the transmission origin ID of the received reaction 
information does not correspond with the noted user ID in the 
5 step S42 above, the CPU 42 determines if all the user ID'S have 
been checked up in the step S42. In case all the user ID'S have 
not been checked, next noted user ID and noted countdown timer 
ID are set, and the control is returned to the step S42 (steps 
S45 and S46) . 

10 In case it is determined in the step S45 that the checkup has 
been completed for all the user ID's, the control moves on 
directly to the step S32. 

Next, the reaction character string display step (step S32) 
is described. In this step, the reaction character strings 108 

15 corresponding to the reaction contents or the contents of the 
received reaction information (such as "I see," and "???" in 
Fig. 13) are displayed. The process is time-wise controlled 
for respective reaction character strings with individual 
countdown timers (not shown) . Each countdown timer is provided 

20 with a countdown timer ID. 

Therefore, it results in that reaction character strings 
corresponding to respective reaction contents are related to 
individual countdown timer ID's. It is adapted that display 
process is made for the respective reaction character strings 

25 in the reaction character display process. The reaction 

contents corresponding to the reaction character string to be 
the subject of the display process is called the noted reaction 
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contents. The countdown timer ID corresponding to the reaction 
character string to be the subject of the display process is 
called the noted countdown timer ID. 

The reaction character string display step, the step S32, is 
5 described in detail in reference to Fig. 10. The CPU 42 of the 
teacher terminal 4 executes first an initializing step (step 
S51) . In the initializing step, initial values are specified 
and set for the noted reaction contents and the noted countdown 
timer ID. 

10 Next, the CPU 42 determines whether or not the contents of 
the received reaction information correspond with the noted 
reaction contents. In case of correspondence, a reaction 
character string 108 corresponding to the noted reaction 
contents is displayed on the graphic display area 101 of the 

15 display screen 100 of the teacher terminal 4. At the same time, 
the countdown timer indicated with the noted countdown timer 
ID is reset, and the control goes to the step S33 (steps S52 
to S54) . 

In the reaction character string display step, the 
20 corresponding reaction character string 108 remains displayed 
until the value of the countdown timer becomes "0." When it 
becomes "0," the display is put out. While the time set with 
this countdown timer is not limited particularly, it is set for 
example to about 3 seconds. In other words, the reaction 
25 character string 108 remains displayed for only a predetermined 
period of time. 

In case the contents of the received reaction information do 
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not correspond with the noted reaction contents in the above 
step S52, the CPU determines if the checkup in the step S52 has 
been made for all the reaction contents. If not completed, the 
CPU 42 sets the next noted reaction contents and noted countdown 
5 timer ID, and moves the control to the step S52 (steps S55 and 
S56) . 

In case it is determined in the step S55 that all the reaction 
contents have been checked up, the control goes directly to the 
step S33. 

10 Next, the reaction graph display process (step S33) is 

described. This process is controlled to display the graph 
columns after changing the heights of the reaction graph columns 
109a, 109b, and 109c representing the received reaction 
contents (such as "I see," "???," "I see," or "???") to the 

15 heights corresponding to the number of times of receiving the 
reaction contents. Each of the graph columns is time-wise 
controlled with an individual countdown timer (not shown) , 
provided with a countdown timer ID. 

Therefore, reaction graph columns corresponding to 

20 respective reaction contents are made to correspond to the 
individual countdown timer ID'S. The reaction graph display 
process is made to execute the display process for each reaction 
graph column. The reaction content corresponding to the 
reaction graph column to be the subject of the display process 

25 is called the noted reaction content, and the countdown timer 
ID corresponding to the reaction graph column to be the subject 
of the display process is called the noted countdown timer ID. 
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The reaction graph display step, the step S33, is described 
in detail in reference to Fig. 11. First, the CPU 42 of the 
teacher terminal 4 executes the initializing step (step S61) . 
In the initializing step, specific initial values are set to 
5 the noted reaction content and noted countdown timer ID. 

Next, the CPU 42 determines whether or not the received 
reaction information content corresponds with the noted 
reaction content. In case of correspondence, the reaction 
graph column corresponding to the noted reaction content is 
10 renewed and displayed on the graphic display area 101 of the 
display screen 100 of the teacher terminal 4. At the same time, 
the countdown timer indicated with the noted countdown timer 
ID is reset, and the control moves to the step S34 (steps S62 
to S64) . 

15 In the reaction graph display process, a renewed reaction 
graph column is displayed until the countdown timer value 
becomes "0." When the value comes to "0," the display is put 
out (the height of the reaction graph column is lowered 
gradually) . While the period of time set for this countdown 

20 timer is not limited particularly, it is set for example to about 
3 seconds. In other words, the renewed reaction graph is 
displayed for only the preset period of time and then put out 
(the height of the reaction graph column is gradually lowered) . 
In case the received reaction information content does not 

25 correspond with the noted reaction content in the above step 
S62, the CPU 42 determines if all the reaction contents have 
been checked in the step S62. If not, the CPU 42 sets the next 
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noted reaction content and noted countdown timer ID and returns 
the control to the step S62 (steps S65 and S66) . 

In case the step S65 determines that all the reaction contents 
have been checked up, the control goes directly to the step S34 . 
5 Next, the reaction record display step (step S34) shown in 
Fig. 8 is described. In this step, the CPU 42 lists records 
(character strings) of the received reaction information 
contents or reaction contents (such as "I see/' and "???" in 
Fig. 13) made to correspond to the transmission origin ID'S and 

10 displays the list on the reaction record area 103 of the display 
screen 100 of the teacher terminal 4 (See Fig. 15) . 

The step S5 in Fig. 7 corresponds to the reaction information 
display means 13 of Fig. 2. The steps S31 to S34 respectively 
correspond to the user icon display means 13a, reaction 

15 character string display means 13b, reaction graph display 
means 13c, and reaction record display means 13d. 

Referring to Fig. 7 again, when the reaction information 
display step, the step S5, is over as described above, the CPU 
42 of the teacher terminal 4 returns the control to the step 

20 SI to repeat the steps SI to S5. Incidentally, the kind of 
reaction information corresponding to the information to be 
shown at the teacher terminal 4 may be chosen appropriately. 

On the other hand, the CPU 62 of the student terminal 6 is 
monitoring the reaction information from other student 

25 terminals 6 (information from other users) . In case the CPU 
62 receives no information from other users, the control returns 
to the step Sll. In case the CPU 62 receives information from 
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other users, information corresponding to the received reaction 
information is displayed (steps S16 and S17) . 

The above-described process in the steps S15 and S17 (reaction 
information display process) is the same as the reaction 
5 information display process in the step S5, except the place 
for displaying the information corresponding to the reaction 
information is the display screen 110 of the student terminal 
6. Also the display screen 110 of the student terminal 6 is 
the same in constitution as the display screen 100 of the teacher 

10 terminal 4 concerning the display of information corresponding 
to the reaction information. Incidentally, the kind of 
reaction information corresponding to the information to be 
displayed on the student terminal 6 may be chosen appropriately. 
Fig. 17 showing the display screen 100 of the student terminal 

15 6 is an example in which nothing corresponding to the reaction 
information is displayed at all on the student terminal 6. 

The step S16 of Fig. 7 corresponds to the other user 
information acquisition means 37, and the steps S15 and S17 
correspond to the reaction information display means 33. 

20 The evaluated object information transmitted from the teacher 
terminal 4 in the step S2 of Fig. 7 and the reaction information 
transmitted from the student terminal 6 in the step S14 are also 
received respectively through the Internet 8 with the data 
control server 10. In other words, the data control server 10 

25 is monitoring the information (communication information) 
transmitted between the teacher terminal 4 and the student 
terminals 6,6, The data control server 10, upon receiving 
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the communication information, stores it in the communication 
information database 80 (steps S21 and S22) . 

While the information stored in the communication information 
database 80 is not limited particularly, for example the 
5 on-blackboard information and various control instruction 
information constituting the evaluated object information, and 
the reaction information to the evaluated object information 
are stored. The control instruction information includes for 
example: choice display instruction information for causing to 

10 display the choice information on the display screen, 

blackboard erasure instruction information for erasing the 
on-blackboard information from the display screen, and display 
instruction information and erasure instruction information 
for images and pictures. 

15 As shown in Fig. 13, in this embodiment, these information 
contents are made to correspond to the kinds of information and 
stored in the order of reception time. Incidentally, The 
reception time is the internal time of the data control server 
10 clocked at 1/60 second intervals. 

20 Contents of the on-blackboard information are for example: 

pen point shape information, color option information, and 
stroke information. The pen point shape information is to 
specify the pen point shape used for writing on the blackboard. 
The color option information includes information on the ink 

25 used, and color information. The information on the ink used 
is for example information for specifying the degree of 
transparency of ink. The color information is the information 
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for specifying the color of ink. The stroke information is made 
up of many coordinate values indicating the pen point loci in 
the graphic display area 101. The pen point loci; or the 
characters, figures, symbols, etc. written on the blackboard 
5 in the graphic display area 101 are expressed as lines tracing, 
in the order of being written, many coordinate values written 
as the stroke information. 

Information items of the choice display instruction include 
for example: transmission origin ID, transmission address ID, 

10 choice number information, and choice content information. 
The transmission origin ID and the transmission address ID are 
respectively information items for specifying transmission 
origin and transmission address of the choice information. In 
case choice information is transmitted from the teacher 

15 terminal 4 to all the student terminals 6, 6, . . . , the 

transmission origin ID and the transmission address ID may be 
omitted. In case the choice information is transmitted to 
specific students, the transmission origin ID and the 
transmission address ID are written. The choice number 

20 information is the information for specifying the choice number. 
The choice content information is the information for 
specifying contents (character strings) to be displayed as 
choices . 

Contents of the reaction information include for example the 
25 transmission origin ID and the reaction content information. 
The transmission origin ID is the information for specifying 
the transmission origin. The reaction content information 
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represents details of the reaction, including for example: 
information on the degree of comprehension of the evaluated 
object information transmitted from the teacher terminal 4, and 
information on the reply to the choice information transmitted 
5 from the teacher terminal 4. 

As will be described later, it is possible to reproduce the 
whole or part of the evaluated object information and the 
information corresponding to the reaction information at the 
teacher terminal 4 or student terminal 6 on the basis of 

10 respective pieces of information stored in the communication 
information database 80. 

The constitution of the communication information database 
is not limited to the above. For example, it is possible to 
classify the communication information into a plural number of 

15 groups and store each group in a dedicated table in the order 
of reception time. In that case, the classification may be made 
for example into: on-blackboard information group, control 
instruction information group, and reaction information group. 
Next, the communication information reproduction process is 

20 described. The communication information reproduction 

process is normally executed at an appropriate time after a 
lecture is over. In reference to Fig. 12, the communication 
information reproduction process executed at the teacher 
terminal 4 is described. 

25 The CPU 42 of the teacher terminal 4, when a communication 
information reproduction process instruction is entered 
through an input device such as a keyboard 4 6 and a mouse 4 8 
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at the teacher terminal 4, demands the data control server 10 
to transmit evaluated object information specified by the 
instruction (step S71) . 

The above communication information reproduction process 
5 instruction includes a evaluated object information demand 
signal and a reaction information demand signal. The evaluated 
object information demand signal is a signal for specifying 
evaluated object information demanded to be transmitted. The 
reaction information demand signal is a signal for specifying 

10 reaction information demanded to be transmitted. 

The data constitution of the evaluated object information 
demand signal is shown in Fig. 14A. The evaluated object 
information demand signal includes: a transmission time field 
indicating the time at which the communication information 

15 reproduction process instruction including the demand signal 
was transmitted, a demand information type field indicating the 
type of information demanded to be transmitted, and a demand 
information contents filed for exactly specifying the 
information item demanded to be transmitted. 

20 The transmission time is the internal time of the teacher 
terminal 4, clocked at 1/60 second intervals. The demand 
information type is for example graphic. The demand 
information contents are for example: start time, time interval, 
and the number of pages of evaluated object information demanded 

25 to be transmitted. The start time is expressed for example in 
1/60 second unit assuming the lecture start to be "0 . " The time 
interval is the sampling period for the evaluated object 



37 



023WO01eng.doc 

information demanded to be transmitted, expressed for example 
in 1/60 second unit. The number of pages is the total number 
of evaluated object information samples demanded to be 
transmitted . 

5 Therefore, it is seen that the evaluated object information 
demand signal shown in Fig. 14A as an example is a signal 
demanding graphic information to be transmitted in a total of 
7 pages at 1 minute intervals from the start of the lecture. 
The data constitution of the reaction information demand 

10 signal is shown in Fig. 14B. Also the reaction information 
demand signal, like the evaluated object information demand 
signal, includes a transmission time field, a demand 
information type field, and a demand information content field. 
However, it is different from the evaluated object information 

15 demand signal in that the demand information contents field 
includes a field for specifying a subject user ID. Specifying 
a subject user ID makes it possible to demand the data control 
server 10 to transmit only reaction information from the student 
terminal 6 corresponding to the specified user ID. In other 

20 words, it is possible to reproduce the situation of the lecture 
while taking note of reaction of a specific student or students. 

The reaction information demand signal shown as an example 
in Fig. 14B is the signal that demands reaction information on 
all the students to be transmitted in a total of 7 pages at 1 

25 minute intervals from the start of the lecture. 

Referring again to Fig. 12, in the step S71, the evaluated 
object information demand signal (in Fig. 14A) is transmitted 
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to the data control server 10. 

The CPU 22 of the data control server 10, upon receiving the 
evaluated object information demand signal through the Internet 
8, extracts the evaluated object information, specified with 
5 the signal, from the communication information database 80, and 
transmit the extracted evaluated object information to the 
teacher terminal 4 through the Internet 8 (step S81) . 

The CPU 42 of the teacher terminal 4 receives the evaluated 
object information transmitted from the data control server 10 

10 (graphic information in this case) and displays information 
corresponding to the received information on the display screen 
100 of the teacher terminal 4 (step S72) . 

On the display screen 100 shown in Fig. 19 are defined two 
communication information reproduction areas 121 and 122. As 

15 a matter of course, the number of the communication information 
reproduction areas is not limited; it may be one, or more than 
two. This example is adapted to display information 
corresponding to the reaction information for all the students 
on the communication information reproduction area 121, and to 

20 display information corresponding to the reaction information 
for a specific student or students on the communication 
information reproduction area 122. 

The evaluated object information acquired in the step S72 is 
displayed in time sequence on the evaluated object information 

25 reproduction area 121a of the communication information 

reproduction area 121. In this embodiment, a total of 7 pages 
of graphic information 123, 123, . . . sampled at one minute 
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intervals from the start of the lecture are displayed in time 
sequence from left to right. 

As shown in Fig. 12, the CPU 42 of the teacher terminal 4 then 
demands the data control server 10 to transmit the reaction 
5 information specified with the reaction information demand 
signal contained in the communication information reproduction 
process instruction (steps S73 to S75) . In other words, the 
data control server 10 is demanded to transmit reaction 
information on all the users in case all the user ID' s are 

10 specified as subjects with the reaction information demand 
signal, or to transmit reaction information on a specific 
student in case a specific user's ID is specified. 

In specific terms, the reaction information as shown in Fig. 
14B is to be transmitted to the data control server 10. 

15 The CPU 22 of the data control server 10, upon receiving the 
reaction information demand signal through the Internet 8, 
extracts the reaction information specified with the demand 
signal from the communication information database 80, and 
transmits the extracted reaction information through the 

20 Internet 8 to the teacher terminal 4 (step S82) . 

The CPU 42 of the teacher terminal 4 receives the reaction 
information transmitted from the data control server 10, and 
displays information corresponding to that information on the 
display screen 100 of the teacher terminal 4 (step S76) . 

25 As the information corresponding to the reaction information 
acquired in the step S76, there are for example a reaction 
information transition graph 124 and reaction record transition 
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information 125 shown in Fig. 19. 

The reaction information transition graph 124 shows 
transition with time of the reaction information from students 
specified with subject user ID's. Inthis embodiment, reaction 
5 information is shown in graphs by the reaction item. In other 
words, the number of pieces of reaction information from the 
subject students are summed up for every reaction item in every 
sampling period, and the transition of respective sums is shown 
in graphs. 

10 The reaction information transition graph 124 in the 

communication information reproduction area 121 of the example 
in Fig. 19 shows with three curves the transition of sums of 
reaction items for all the students (for example, three types 
of comprehension degree: "I see," "???," "I see" or "???") in 

15 every sampling period (one minute) from the start of the lecture . 
In this example, the reaction information transition graph 124 
is displayed as superposed on the evaluated object information 
in the evaluated object information reproduction area 121a. Of 
course, the place for displaying the reaction information 

20 transition graph 124 is not limited to this. 

Next, the reaction record transition information 125 is a 
time-sequential list of reaction information (vertically 
displayed in this case) from students specified with the subject 
user ID' s within a specific period of time (one sampling period) . 

25 A plural pieces of reaction record transition information 125 
produced at every period are further displayed in time sequence 
to constitute a reaction record reproduction area 121b. This 
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embodiment is adapted to display the reaction record transition 
information 125 with the reaction information contents made to 
correspond to the students or transmitting persons. 
In the reaction record reproduction area 121b of the 
5 communication information reproduction area 121 in the example 
of Fig. 19, reaction record transition information 125 is 
displayed in time sequence (from left to right in this case) 
for all the students at every sampling period (one minute) from 
the start of the lecture. 

10 As shown in Fig. 19, the communication information 

reproduction area 121 is adapted to display: the graphic 
information 123 or the evaluated object information, the 
reaction information transition graph 124 showing the reaction 
to the evaluated object information, and the reaction record 

15 transition information 125, for every sampling period, adjacent 
to each other (one over another in this case) . Therefore, it 
is possible to analyze later the lecture in time sequence. 

Further as shown in Fig. 19, a reception time display area 
121c for displaying both the time of receiving the evaluated 

20 object information and the reaction information (in this case 
equivalent to the time elapsed from the start of the lecture) 
is provided between the evaluated object information 
reproduction area 121a and the reaction record reproduction 
area 121b of the communication information reproduction area 

25 121. 

The communication information reproduction area 122 shown in 
Fig. 19 is different from the communication information 
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reproduction area 121 in that the former is for all the students 
as subjects. The evaluated object information reproduction 
area 122a, reaction record reproduction area 122b, and 
reception time display area 122c of the communication 
5 information reproduction area 122 respectively correspond to 
the evaluated object information reproduction area 121a, 
reaction record reproduction area 121b, and reception time 
display area 121c of the communication information reproduction 
area 121. 

10 Parallel display of the communication information 

reproduction area 121 for all the students and the communication 
information reproduction area 122 for specific students in the 
single display screen 100 as described above conveniently 
permits easy observation of the difference between the two. Of 

15 course it is possible to display a plural number of 

communication information reproduction areas for a plural 
number of students in the single display screen 100. 

The steps S71 to S76 in Fig. 12 correspond to the communication 
information reproduction means 14 in Fig. 2. 

20 While this embodiment is described as an example case in which 
the communication information reproduction process is executed 
at the teacher terminal 4, the process may also be executed at 
the student terminal (s) 6. The communication information 
reproduction process at the student terminal 6 is the same as 

25 that executed in the above steps S71 to S76 except that the place 
of displaying the information corresponding to the 
communication information acquired from the data control server 
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10 is the display screen 110 of the student terminal 6, The 
process of the data control server 10 corresponding to the above 
is also the same as that in the above steps S81 and S82. Also 
the display screen 110 of the student terminal 6 is the same 
5 in constitution as the display screen 100 of the teacher 

terminal 4 concerning the display of information corresponding 
to communication information. 

In case the communication information reproduction process 
is executed at the student terminal 6, the process for specific 

10 student may restrict its subject to oneself. 

The communication information reproduction process at the 
student terminal 6, similar to that in the steps S71 to S76 in 
Fig. 12, corresponds to the communication information 
reproduction means 34 in Fig. 3. 

15 While the above embodiment is described as an example case 
in which the invention is applied to remote teaching provided 
through the communication network on the assumption that the 
provider side terminal is the teacher terminal and the user 
terminal is the student terminal, the invention is not limited 

20 to this. While it may be applied as a matter of course to 
lectures given through the information communication network, 
it may be applied to any systems required to provide evaluated 
object information through an information communication 
network and to accurately grasp reactions to the evaluated 

25 object information without using special equipment, for example 
to presentations, conferences, auctions, etc. 

In the embodiment described above, the user side terminal 
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devices are assumed to be personal computers . However, the user 
side terminal devices are not limited to personal computers. 
For example, portable phones and portable information terminals 
may be used as the user side terminal devices. 
5 Further, block diagrams, hardware constitution, flowcharts, 
data constitution, specific data of various types, mentioned 
above are explained as examples. The invention is not limited 
to such specific examples. 

Further, types and number of databases are not restricted 

10 particularly. The above-described database may be divided 
into a plural number of databases. 

The above embodiment is described as an example in which the 
provider side terminal device and the communication information 
memory device are interconnected through the information 

15 communication network. However, the invention is not limited 
to the above. For example, the provider side terminal device 
and the communication information memory device may be 
interconnected directly, or a single device serving both as the 
provider side terminal device and as the communication 

20 information memory device may be used. Also it is possible to 
distribute a plural number of computers in different places to 
constitute a communication information memory device. In case 
of such distribution, they can be interconnected through an 
information communication network. 

25 While the above embodiment as an example is described with 
a single provider side terminal device, it is possible to use 
a plural number of provider side terminal devices. In that case, 
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it is possible to make the provider side terminal devices 
mutually communicable, or make the user side terminal devices 
and the provider side terminal devices mutually communicable, 
through a communication network. 
5 While the above embodiment is described with the Internet as 
an example of information communication network, the 
information communication network is not limited to the 
Internet. The invention may also be embodied using a network 
such as a LAN (local area network), WAN (wide area network), 

10 or intranet to interconnect a plural number of computers. 

This embodiment is adapted that the program executed on the 
provider side terminal device is the one installed on the 
provider side terminal device. However, the manner of storing 
the program for the provider terminal device side is not limited 

15 to the above; the program may be stored for example on a CD-ROM, 
flexible disk, magnetic tape, etc. 

Further it is possible to distribute the program for the 
provider terminal device side through wired or wireless 
communication network. Further it is possible to store the 

20 program for the provider terminal device side in a program 
server (not shown) and cause a local computer to execute the 
program through an information communication network such as 
the Internet. 

The above embodiment is also adapted to load the program for 
25 the user terminal device side before being executed every time 
from the program distribution server through the information 
communication network onto the main memory of the user side 
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terminal device, and erase the program when its execution is 
over. However, the manner of distributing the program on the 
user terminal device side is not limited to the above. 

For example, it is possible to download first the program on 
5 the user terminal device side from the program distribution 
server through the information communication network onto an 
external memory device such as a hard disk, load it from the 
external memory device onto the main memory, and execute it. 
In this way, from the next time on, the program may be executed 
10 without gaining access to the program distribution server. 

It is also possible to distribute the program for the user 
terminal device side using a recording medium such as a CD-ROM, 
flexible disk, magnetic tape, etc. 

Also the manner of recording and distributing programs and 
15 data are not limited particularly. In addition to recording 
on recording media and distributing them for direct execution, 
it is also possible for example to record it on a recording medium 
in compressed form and distribute it to be extracted and used. 
While the above embodiment is described as an example of 
20 realizing the functions of Figs. 2 and 3 using a computer, it 
is also possible to constitute part of the functions using a 
hardware logic. 

The reaction information display system according to this 
invention comprises: a provider side terminal device having a 
25 provider side display device, and a plural number of user side 
terminal devices each having a user side input operation device 
and a user side display device, and capable of communicating 
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through an information communication network with the provider 
side terminal, characterized in that the provider side terminal 
device has a evaluated object information transmission means 
for transmitting evaluated object information, the user side 
5 terminal device has a evaluated object information display 
means for receiving and displaying the evaluated object 
information transmitted from the provider side terminal device 
through the information communication network on the user side 
display device and a reaction information transmission means 

10 for transmitting reaction information made to correspond to the 
user side terminal device when the user side input operation 
device is operated in reaction to the displayed evaluated object 
information, and the provider side terminal device further has 
a reaction information display means for receiving reaction 

15 information transmitted from the user side terminal device 
through the information communication network and for 
displaying information corresponding to the received reaction 
information on the provider side display device. 

The provider side terminal device according to this invention 

20 is the provider side terminal device used in a system 

comprising: the provider side terminal device having a provider 
side display device, and a plural number of user side terminal 
devices each having a user side input operation device and a 
user side display device, and capable of communicating through 

25 an information communication network with the provider side 
terminal, characterized by comprising: a evaluated object 
information transmission means for transmitting evaluated 
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object information, and a reaction information display means 
for receiving through the information communication network the 
reaction information, made to correspond to the user side 
terminal device, transmitted as a result of the user side input 
5 operation device being operated in reaction to the evaluated 
object information transmitted with the evaluated object 
information transmission means and received through the 
information communication network with the user side terminal 
device and displayed on the user side display device, and for 

10 displaying information corresponding to the received reaction 
information on the provider side display device. 

The user side terminal device according to this invention is 
the user side terminal device used in a system comprising: a 
provider side terminal device having a provider side display 

15 device, and a plural number of user side terminal devices each 
having a user side input operation device and a user side display 
device, and capable of communicating through an information 
communication network with the provider side terminal, 
characterized by comprising: a evaluated object information 

20 display means for receiving and displaying the evaluated object 
information transmitted from the provider side terminal device 
through the information communication network on the user side 
display device, and a reaction information transmission means 
for transmitting reaction information when the user side input 

25 operation device is operated in reaction to the displayed 
evaluated object information, so that information, 
corresponding to the reaction information made to correspond 
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to the user side terminal device and transmitted through the 
information communication network to the provider side terminal 
device, is displayed on the provider side display device. 
The computer program and the recording medium recording the 
5 computer program according to the invention are characterized 
by causing a provider side terminal device used in a system 
comprising: a provider side terminal device having a provider 
side display device, and a plural number of user side terminal 
devices each having a user side input operation device and a 

10 user side display device, and capable of communicating through 
an information communication network with the provider side 
terminal, to function as: a evaluated object information 
transmission means for transmitting evaluated object 
information, and a reaction information display means for 

15 receiving through the information communication network the 
reaction information, made to correspond to the user side 
terminal device, transmitted as a result of the user side input 
operation device being operated in reaction to the evaluated 
object information transmitted with the evaluated object 

20 information transmission means and received through the 

information communication network with the user side terminal 
device and displayed on the user side display device, and for 
displaying information corresponding to the received reaction 
information on the provider side display device. 

25 The computer program and the recording medium recording the 
computer program according to the invention are characterized 
by causing a user side terminal device used in a system 
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comprising: a provider side terminal device having a provider 
side display device, and a plural number of user side terminal 
devices each having a user side input operation device and a 
user side display device, and capable of communicating through 
5 an information communication network with the provider side 
terminal, to function as: a evaluated object information 
display means for receiving evaluated object information 
transmitted from the provider side terminal device through the 
information communication network and displaying the received 

10 information on the user side display device, and a reaction 
information transmission means for transmitting reaction 
information when the user side input operation device is 
operated in reaction to the displayed evaluated object 
information, so that information, corresponding to the reaction 

15 information made to correspond to the user side terminal device 
and transmitted through the information communication network 
to the provider side terminal device, is displayed on the 
provider side display device. 

In other words, the reaction information display system, the 

20 provider side terminal device, the user side terminal devices, 
the computer program, and the recording medium recording the 
computer program according to the invention are constituted as 
follows: The provider side terminal device is communicable 
with a plural number of user side terminal devices through the 

25 information communication network. The provider side terminal 
device transmits evaluated object information. The user side 
terminal device receives the transmitted evaluated object 
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information through the information communication network and 
displays the received information on the user side display 
device. When the user side input operation device is operated 
in reaction to the displayed evaluated object information, the 
5 user side terminal device transmits reaction information made 
to correspond to the user side terminal device. The provider 
side terminal device receives the transmitted reaction 
information through the information communication network and 
displays information corresponding to the received reaction 

10 information on the provider side display device. 

Therefore, the user (for example a student) can see the 
evaluated object information (for example contents of a 
lecture) , transmitted from the information provider (for 
example a teacher) and displayed on the user side display device 

15 (for example an LCD) , and can transmit reaction to the displayed 
information (for example XX I see") to the information provider 
by operating the user side input device (for example a keyboard 
or mouse) . The information provider can immediately find out 
how the student reacted to the transmitted evaluated object 

20 information upon seeing the information, corresponding to the 
reaction information, displayed on the provider side display 
device (for example an LCD). 

In other words, the constitution, though simple without using 
special equipment, makes it possible to easily grasp the 

25 reaction of many users to a single evaluated object information 
presented through the information communication network in real 
time. Therefore, it is possible for each user to share the same 
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feeling as if all the users were present in the same place facing 
the information provider to watch and listen to the evaluated 
object information . 

With the reaction information display system, the provider 
5 side terminal device, the computer program, and the recording 
medium recording the computer program according to the 
invention, the reaction information display means is 
characterized by comprising a user icon display means that 
controls to define a user icons collective display area, in 

10 which a plural number of user icon display areas made to 

correspond to respective user side terminal devices are put in 
order, in part of the provider side display device, and controls 
so that information corresponding to the reaction information 
from respective user side terminal devices is displayed with 

15 icons in corresponding user icon display areas. 

In other words, a plural number of icons corresponding to the 
respective users may be collectively displayed on the provider 
side terminal device. Reactions from the respective users, in 
the form of icons corresponding to the reactions, are displayed 

20 on the corresponding user icon display areas. 

Therefore, the information provider, upon seeing the user 
icons collective display area defined on the provider side 
display device, can grasp at a glance which user has shown what 
reaction to the evaluated object information transmitted. 

25 The reaction information display system and the provider side 
terminal device according to the invention are characterized 
as follows: The system further comprises the communication 
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information memory device having a communication information 
database storing communication contents, communicated between 
respective terminal devices constituting the system, in 
relation to communication times and information types. The 
5 provider side terminal device further comprises a communication 
information reproduction means that acquires the whole or part 
of the information communicated between respective terminal 
devices and stored in the communication information database 
while specifying communication time and information type and 

10 reproduce information corresponding to the acquired 
information on the provider side display device. 

The computer program and the recording medium recording the 
computer program according to the invention is characterized 
as follows: The system further comprises the communication 

15 information memory device having a communication information 
database storing communication contents, communicated between 
respective terminal devices constituting the system, in 
relation to communication times and information types. The 
computer program further causes the provider side terminal 

20 device to function as a communication information reproduction 
means that acquires the whole or part of the information 
communicated between respective terminal devices and stored in 
the communication information database while specifying 
communication time and information type and reproduces 

25 information corresponding to the acquired information on the 
provider side display device. 

In other words, with the reaction information display system, 
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the provider side terminal device, the computer program, and 
the recording medium recording the computer program according 
to the invention, the information contents communicated between 
the respective terminal devices are related to communication 
5 time and type of information and stored in the communication 
information database. The information provider can acquire 
the whole or part of the information stored in the communication 
information database while specifying communication time and 
type of information, and reproduce and display information 

10 corresponding to the acquired information on the provider side 
display device. 

Therefore, the information provider, upon seeing the 
information reproduced on the provider side display device, can 
confirm at a later time what reaction at what time point the 

15 user showed to the transmitted evaluated object information. 

The user side terminal device according to the invention is 
further characterized in that it is communicable with other user 
side terminals through the information communication network 
and that it further comprises: an other user information 

20 acquisition means for receiving information transmitted from 
other user side terminal devices through the information 
communication network, and a reaction information display means 
for displaying on the user side display means information 
corresponding to the reaction information from the respective 

25 user side terminal devices. 

With the computer program and the recording medium recording 
the computer program, the user side terminal device is 
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characterized by being communicable with other user side 
terminal devices through the information communication network. 
The computer program is further characterized to cause the user 
side terminal device to function as an other user information 
5 acquisition means for receiving through the information 

communication network reaction information transmitted from 
other user side terminal devices and as a reaction information 
display means for displaying information corresponding to the 
reaction information from the respective user side terminal 

10 devices on the user side display device. 

In other words, with the user side terminal device, the 
computer program and the recording medium recording the 
computer program, the user side terminal device can communicate 
also with other user side terminal devices through the 

15 information communication network, and can receive reaction 
information transmitted from other user side terminal devices 
to display information corresponding to the reaction 
information from respective other user side terminal devices 
on the user side display device. 

20 Therefore, the user can immediately find out what reaction 
other users showed to the evaluated object information 
transmitted from the information provider. Therefore, it is 
possible for each user to share the same feeling as if all the 
users were present in the same place facing the information 

25 provider to watch and listen to the evaluated object 
information. 

With the user side terminal device, the computer program, and 
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the recording medium recording the computer program, the 
reaction information display means is characterized by 
comprising a user icon display means that controls to define 
a user icons collective display area, in which a plural number 
5 of user icon display areas made to correspond to respective user 
side terminal devices are put in order, in part of the user side 
display device, and to display information corresponding to the 
reaction information from respective user side terminal devices 
using icons in corresponding user icon display areas. 

10 In other words, it is possible to display collectively a plural 
number of icons corresponding to respective users including 
other users on the user side display device. Reaction from each 
user is displayed as an icon corresponding to the reaction in 
a corresponding icon display area. 

15 Therefore, each user, upon seeing the user icons collective 
display area defined on the user side display device, can grasp 
at a glance what user showed what reaction to the evaluated 
object information received. 

With the user side terminal devices according to the invention, 

20 it is characterized that the system further comprises a 

communication information memory device having a communication 
information database for storing information contents, related 
to communication time and type of information, communicated 
between terminal devices constituting the system, and the user 

25 side terminal device is capable of communicating with also the 
communication information memory device through the 
information communication network, and the user side terminal 
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device comprises a communication information reproduction 
means for acquiring, while specifying communication time and 
type of information, the whole or part of information 
communicated between respective terminal devices and stored in 
5 the communication information database and reproducing 

information corresponding to the acquired information on the 
user side display device. 

With the computer program and the recording medium recording 
the computer program according to the invention, it is 

10 characterized in that the system further comprises a 

communication information memory device having a communication 
information database storing information contents 
communicated between terminal devices constituting the system 
in relation to communication time and type of information, the 

15 user side terminal devices are communicable with the 
communication information memory device through the 
information communication network, and the computer program 
further causes the user side terminals as communication 
information reproduction means for acquiring, while specifying 

20 communication time and type of information, the whole or part 
of information communicated between the terminal devices and 
stored in the communication information database and 
reproducing and displaying on the user side display devices 
information corresponding to the acquired information, 

25 In other words, with the user side terminal devices, the 
computer program, and the recording medium recording the 
computer program according to the invention, contents of 
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information, communicated between the terminal devices in 
relation to communication time and type of information are 
stored in the communication information database, and the users 
can acquire, while specifying communication time and type of 
5 information, the whole or part of information stored in the 
communication information database, and reproduce and display 
information corresponding to the acquired information on the 
user side terminal device. 

Therefore, users can reconfirm the evaluated object 

10 information reproduced and displayed on the user side terminal 
devices. It is also possible for a user to confirm at a later 
time what reactions the user himself or herself or other users 
showed at what time point to the evaluated object information. 
While the invention is described above as a preferable 

15 embodiment, the wording is used not for restriction but for 
explanation and therefore may be changed within the scope of 
appended claims without departing from scope and spirit of the 
invention. 

20 
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